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METHOD OF REAL TIME COLLISION 
DETECTION BETWEEN GEOMETRIC MODELS 



BACKGROUND OF THE INVENTION 
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1. 



Field of the Invention 



The present invention relates generally to 
computer-aided design of vehicles and, more 
specifically, to a method of real time collision 
detection between geometric models in the design of a 
vehicle . 

2 • Description of the Related Art 

Vehicle design, and in particular the design 
of an automotive vehicle, has advanced to a state in 
which computer aided design techniques are frequently 
incorporated in the development of a new vehicle, or 
redesign of an existing vehicle. At the same time, 
enhanced visualization software tools have been 
developed that allow for interactive display and 
evaluation of large models, including models developed 
using computer aided design. In the field of vehicle 
design, the use of both computer aided design and 
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visualization techniques is especially beneficial in 
designing, packaging and assembling the various systems 
incorporated within the vehicle, to maximize the design 
and functional capabilities of these vehicles. 
5 Advantageously, potential vehicle system designs can be 
considered in a timely and cost-effective manner by 
analyzing a digital representation of a proposed 
design, versus preparing an actual vehicle model. 

Various aspects of the design task for a 

10 vehicle include detecting interferences between 
components, evaluating assembly processes, and 
understanding vehicle ergonomics. Recently, these 
types of design tasks have been accomplished using 
tools such as virtual reality simulations. 

15 A user held interface device, such as a 

haptic interface, serves as a tactical interface 
between the user and the virtual world. The haptic 
interface allows the computing of reaction forces as a 
result of touching or pushing a virtual object and is a 

20 physical device that delivers the computed force to the 
user through an end effector. An example of such a 
haptic interface is disclosed in commonly assigned U.S. 
Patent No. 5,694,013 to Stewart et al., entitled "Force 
Feedback Haptic Interface For a Three-Dimensional CAD 
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Surface/' the disclosure of which is incorporated by 
reference. Advantageously, the haptic device reproduces 
at a high rate of speed the sensation of freely moving 
an object within a constrained environment by 

5 determining ' the forces exchanged between the 
interacting geometries . 

Collision detection is one technique used to 
compute reaction force by determining whether, and by 
how much, two objects interpenetrate. Various collision 

10 detection methods have been utilized in the past. One 
method involves a volumetric representation that 
divides a space into small eight-sided units, called 
voxels. Each voxel is assigned a value of zero if part 
of free space, or one if part of the object. The set 

15 of all voxels is called a voxmap. A collision is 
determined by computing the discrete position of a 
point in space in the voxmap and checking if the 
corresponding element is zero, representing no 
collision or one, signaling a collision. While this 

20 method works well for simple systems, it is less 
accurate for more complex models, since the size of the 
individual voxel determines the accuracy of the 
geometric representation. Also, it is difficult to 
accurately prepare a voxmap from a model as complex as 



a CAD model of a vehicle, or convert a modified voxmap 
back into a CAD model. 

Another method of collision detection 
includes creating a mesh model of the CAD model, which 
is a collection of polygons describing the surface of 
the CAD model. While this method works well, the 
search for a polygon colliding with the haptic device 
is more time consuming than the voxel method. Also, 
unless the CAD model is already in a mesh format, the 
geometry represented by a NURBS format, or other free 
form representations, have to be translated into a 
mesh. A disadvantage is a decrease in model fidelity 
and topology. 

Still another method of collision detection 
includes a tracking algorithm to detect collisions with 
a free form surface. The tracking algorithm determines 
a tracking point on the surface of the CAD model using 
a numerical approximation starting from the closest 
point calculated during a previous iteration. Thus, 
once an initial point is found, the motion of a cursor 
can by tracked over the surface. Only the parametric 
domain and trim boundaries limit the tracking motion. 
While tracking algorithms work well for collision 
detection, it can be difficult and time consuming to 
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find an initial starting point. Also, certain 
geometric features of a NURBS surface, such as ridges 
and cusps formed by points and knots need to be 
considered separately from the other NURBS surfaces of 
5 the CAD model. Traditionally, the closest point to a 
polygonal mesh is found by representing the mesh as an 
unconnected group of triangles. A map, such as a 
Voronoi map is used to assign the elements of the 
polygonal soup to different regions of the map, so that 

10 coherence can be exploited to check the distance to 
only those polygons belonging to regions that neighbor 
the current location of the potentially colliding 
point. However, this technique does not take advantage 
of connectivity between triangles by assuming the mesh 

15 represents a manifold and each triangle will have 
neighboring triangles, and each vertex a set of 
connected polygons. 

Thus, there is a need in the art for an 
efficient method of real time collision detection 

20 between a point and a tessellated mesh of a computer 
aided design model and force feedback to a user 
regarding the collision. 
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SUMMARY OF THE INVENTION 

Accordingly, the present invention is a 
method of real-time collision detection between 
5 geometric models. The method includes the steps of 
identifying a current tracking point of a force 
feedback interface colliding with a mesh model of the 
geometric model and identifying a current triangle 
associated with the current tracking point. The force 

10 feedback interface is operatively connected to a 
computer system. The method also includes the steps of 
determining a new tracking point of the force feedback 
interface colliding with the mesh model by 
approximating the new tracking point from the current 

15 tracking point and the current triangle, and 
determining a state of the new tracking point using the 
new tracking point and the state of the previous 
tracking point, wherein the state is inside, on an edge 
or on a vertex of either the current triangle or a new 

20 triangle. The method further includes the steps of 
using the state of the new tracking point to determine 
if a predetermined condition is met to conclude that 
the new tracking point is on the current triangle or if 
another predetermined condition is met to conclude that 



the new tracking point crossed to a new triangle, 
wherein the new triangle is connectively associated 
with the current triangle. 

One advantage of the present invention is 
that a method of real-time collision detection between 
geometric models is provided that detects a collision 
between a point and a tessellated mesh of the model. 
Another advantage of the present invention is that a 
method is provided that is mathematically efficient in 
detecting a collision within a complex CAD model. Yet 
another advantage of the present invention is that a 
method is provided that can be utilized in interactive 
visual simulations. Still another advantage of the 
present invention is that the method integrates tactile 
feedback in a force enabled simulation to replicate a 
physical interaction between the user and the model. A 
further advantage of the present invention is that a 
method is provided that determines a dynamic motion 
generated by the collisions between an object and the 
CAD model . 

Other features and advantages of the present 
invention will be readily appreciated, as the same 
becomes better understood, after reading the subsequent 
description taken in conjunction with the accompanying 
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drawings . 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a perspective view of a system for 
5 implementing a method of real time collision detection 
between geometric models. 

FIG. 2 is a perspective view illustrating the 
use of the system and method of real time collision 
detection between geometric models in a virtual 
10 environment . 

FIGS. 3A through 3E are flowcharts of a 
method of real time collision detection between 
geometric models, according to the present invention. 

FIG. 4 is a diagrammatic view illustrating a 
15 triangle and tracking point according to the method of 
FIG. 3. 

FIGS. 5A and 5B are diagrammatic views 
illustrating an INSIDE state for a new tracking point, 
according to the method of FIG. 3. 
20 FIGS. 6A and 6B are diagrammatic views 

illustrating finding a new tracking point starting from 
a previous position on an edge according to the method 
of FIG. 3. 

FIGS. 7A and 7B are diagrammatic views 
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illustrating alternatives for finding a new tracking 
point starting from a previous position on an edge, 
according to the method of FIG. 3. 

FIGS . 8 A and 8B are diagrammatic views 
5 illustrating alternatives for finding a new tracking 
point starting from a previous position on a vertex, 
according to the method of FIG. 3. 

FIGS. 9A through 9C are diagrammatic views 
illustrating finding a new tracking point when the 
10 tracking point motion is contained within a current 
facet, according to the method of FIG. 3. 

FIGS. 10A through 10C are diagrammatic views 
illustrating finding a new tracking point when the 
displacement is large relative to the size of the 
15 facet, according to the method of FIG. 3. 

FIGS. 11A through 11C are diagrammatic views 
illustrating finding a new tracking point constrained 
on a convex edge, according to the method of FIG. 3. 

FIGS. 12A through 12D are diagrammatic views 
20 illustrating a tracking point moving along an edge, 
according to the method of FIG. 3. 

FIGS. 13A through 13D are diagrammatic views 
illustrating a tracking point constrained to a vertex 
and moving away from a vertex, according to the method 
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of FIG. 3. 

FIG. 14 is a perspective view illustrating a 
computer system for implementing the method of FIG. 3. 

FIG. 15 is a diagrammatic view illustrating a 
force feedback of the tracking point, according to the 
method of FIG. 3. 

DESCRIPTION OF THE PREFERRED EMBODIMENT (S) 

Vehicle design is achieved, according to the 
present invention, with a generic parametric driven 
design process. Advantageously, this process allows 
for flexibility in vehicle design and engineering 
analysis of the design in a fraction of the time 
required using conventional design methods. Various 
computer based tools are integrated to achieve this 
enormous time and expense savings, including solid 
modeling, parametric design, and automated studies. 

Referring to the drawings and in particular 
FIGS. 1 and 2, one embodiment of tools 10 used by a 
method of real time collision detection with a 
geometric model, according to the present invention, 
are illustrated graphically. Advantageously, the tools 
10 can be utilized to evaluate a vehicle design based 
on various factors, such as assembly verification, and 
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ergonomics, early in the design process. The tools 10 
include a force feedback interface 12 operated by a 
user 14 that provides position, orientation, and force 
feedback between the user 14, a computer system 16, and 
5 an object 18 such as a vehicle model. It should be 
appreciated that the model refers to a three- 
dimensional geometric model, or a physical model as 
illustrated in FIG. 2. The model is typically 
generated through the use of conventional computer 

10 aided design (CAD) , including computer aided 
manufacturing (CAM) and computer aided engineering 
(CAE) techniques. 

An example of a force feedback interface 12 
is a haptic device, as is known in the art. The force 

15 feedback device 12 includes an end effector 20, such as 
a stylus, pen, or any other similar gripping device. 
The end effector 20 is grasped by a user 14 and 
generates sensations of rigidity and facial roughness 
of the object 18. In automotive styling, for example, 

20 the end effector 20, in conjunction with the collision 
detection method to be described, enables the user 14 
to touch, feel and edit complex three-dimensional CAD 
geometry. The end effector 20 also transmits contact 
force information to the user 14, to indicate a 
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collision. For example, the end effector 20 provides a 
physical connection between a hand 22 of the user 14 
and a computer model, allowing the user 14 to touch the 
computer model. For example, the user 14 can tap on a 

5 portion of the computer model. Advantageously, the 
force feedback interface provides an interface between 
a real world and a virtual world. 

The force feedback device 12 also includes a 
hingeable arm 24 operatively connected to the end 

10 effector 20. In this example, there is an upper arm 26 
and a lower arm 28. The lower arm 28 is operatively 
attached to a base 30. The hingeable arm 24 is 
operatively connected to an actuating device 32, such 
as a servo I/O interface, or other similar device 

15 capable of transmitting forces to the end effector 20 
through the upper and lower arms 26, 28 in at least 
three degrees of freedom. Information regarding a 
collision with the object 18 is transmitted through the 
end effector 20 and the upper and lower arms 2 6, 28 to 

20 the computer system 16. The collision may include a 
single point of contact, or multi-point contact, 
referred to as tracking. 

The tools 10 further include a computer 
system 16, as is known in the art, operatively 
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connected to the force feedback device 12. The 
computer system 16 includes a processor, a controller, 
and a memory to process information relevant to the 
method of real time collision detection between 

5 geometric models. The computer system 16 includes a 
display device 34, such as a video terminal, to display 
the vehicle model. The user 14 inputs information into 
the computer system 16 when prompted to do so. 
Selection and control of the information within a 

10 screen can be achieved by the user 14 via a user 
interactive device 36, such as a keyboard. The set of 
parameters or the set of instructions may be specific 
to the method of collision detection, wherein other 
data and information non-specific to the method of 

15 collision detection may already be stored in the memory 
of the computer system 16. One example of an input 
method is a pop-up dialog box containing available 
information or instruction. For example, information 
may be representative of different vehicle design 

20 alternatives. The computer system 16 utilizes the set 
of information or instruction from the user 14 and any 
other information in carrying out a method, according 
to the present invention and discussed in . detail 
subsequently, of real time collision detection between 
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geometric models. 

It should be appreciated that the computer 
system 16 may include a plurality of interconnected 
computer systems, as illustrated in FIG. 14. For 
5 example, the computer system 16 may include a first 
computer system 38 that operates at a slower, higher 
level, to carry out the method of collision detection, 
to be described. The first computer system 38 is 
operatively connected to a second computer system 40, 

10 that operates at a faster, lower level, to implement 
the force feedback feature of the method. The second 
computer system 40 operates at a higher refresh rate, 
iteratively reading the end effector position in joint 
space, transforming the position into Cartesian space, 

15 and calculating the desired force to be applied by the 
end effector 20 in Cartesian space based on the 
geometry of a local feature on the mesh model, and the 
desired impedance-physical properties of the mesh 
model, and mapping such forces onto joint space to 

20 calculate the desired torques to command the device 
actuators . 

The tools 10 also include a virtual reality 
display system 42, such as a head mounted display 
mechanism 44, as is known in the art. The head mounted 



* ♦ 

15 



display mechanism 44 is worn by the user 14 and allows 
the user 14 to "see" a virtual environment, which in 
this example is the CAD model of a vehicle. The virtual 
reality display system 42 is in communication with the 

5 computer system 16, and provides the user 14 a view 
through a virtual human's eyes, or a first person view 
of the virtual environment. 

In operation, the controller sends the 
computer system 16 a signal representing a joint 

10 position for the joints between the end effector 20, 
upper arm 26, lower arm 28 and base 30, respectively. 
The computer system 16 sends force signals to a 
controller (not shown) , which controls the actuating 
device 32 to produce the necessary forces at the force 

15 feedback device 12. The user 14 can view the geometric 
model on the display screen 34 or in the head mounted 
display mechanism 44. The user 14 uses the end 
effector 20 to "track" along a surface of the geometric 
model . 

20 The method of the present invention enables 

the user 14 to touch, feel and edit the geometric 
model. Advantageously, this is a time and cost savings 
as compared to performing the same operations on a 
physical prototype. Furthermore, the computer 
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implemented method of real time collision detection 
between geometric models combines all of the foregoing 
to provide an efficient, flexible, rapid tool for 
evaluating the design of a vehicle. Also, information 
5 obtained during the subjective evaluation of the design 
is an output of the method and is available for further 
analysis and study. 

Referring to FIG. 3A, a method, according to 
iih the present invention, of real time collision detection 

-pr 

fh 10 between geometric models is illustrated. The method 

m begins in block 100 and continues to block 105. In 

U block 105, the methodology determines an initial 

=U tracking point on a tessellated mesh model of the 

U vehicle model of this example for the first iteration 

fg 15 of the methodology. It should be appreciated that the 

initial tracking point is a point of contact of the end 
effector 20 held by the user 14 on the vehicle model. 
The initial tracking point may be identified using a 
technique known in the art as OctTree hierarchic 
20 structures. The methodology also identifies a current 
triangle (TJ shown in FIG. 4 at 52 containing the 
current tracking point (P 0 ) shown at 54. It should be 
appreciated that the tessellated mesh model of the 
vehicle model is built by creating a topological 
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structure of the vehicle model by organizing a list of 
triangles into a connected surface mesh. The mesh is a 
collection of polygons, which in this example are 
triangles, describing a surface of a solid object. 

5 Preferably, the surface is divided into a large number 
of triangles, to represent surface details with a 
certain degree of accuracy. Further the size of the 
polygons may net be fixed within all locations on the 
surface of the model. 

10 Advantageously, the methodology makes 

assumptions regarding the connectivity of the 
triangles. Thus, it is assumed that each triangle will 
have an inside area 56, neighboring triangles along its 
edges 58, and each vertex 60 has a set of connected 

15 polygons (not shown) . The methodology also assumes 
that each facet 62 will have no more than three 
neighboring triangles, each sharing an entire edge 58 
with the facet 62. The methodology further relies on 
knowing all the triangles connected to each vertex 60. 

20 It should be appreciated that the model may need to be 
remeshed to ensure that these conditions are satisfied. 
The methodology advances to block 110. 

In block 110, the methodology sets a state 
flag indicating a current location of the tracking 
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point 54 to INSIDE. It is initially assumed that for 
the first iteration of the methodology the tracking 
point 54 is located inside the current triangle 52, in 
order to determined the location of a new tracking 
5 point 64. Further, it is understood that an INSIDE 
state refers to a tracking point positioned within the 
boundaries of a triangle. Likewise, an EDGE state 
refers to a tracking point positioned on an edge 58, 
and a VERTEX state refers to a tracking point 

10 positioned at a vertex 60, respectively. The 
methodology advances to block 115. 

In block 115, the methodology determines a 
new or the next tracking point Pi shown at 64 for the 
current end effector position, based upon information 

15 known about the previous track point (P 0 ) 54, and the 
corresponding current triangle (T 0 ) 52. For example, the 
current triangle 52, current end effector position, and 
a previous vector are all known. Therefore, a new 
point Pi shown at 64 may be found by projecting a vector 

20 containing the device point P d shown at 65 down onto a 
plane defined by the current triangle T 0 as shown in 
FIG. 4. The equation: 

Pi = Po + (PoPd " PoPd * n) , 

where P d is the end effector position may be used to 
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find point Pi. The methodology advances to block 120. 

In block 120, the methodology determines the 
intersection of the vector PoPi with a proper edge of 
the current triangle. The intersection may be found by 
5 expressing the vector P 0 Pi and the edge using a 
parametric equation P V ect = ?o + t ve ct (Pi~ p o) and P e dge= v i + 

tedge (V 2 "Vi) as function Of tedge and tvect- 

It should be appreciated that the new 
tracking point can be located in one of several states, 
10 such as inside the current triangle, or along an edge 
of the current triangle, or on a vertex of the current 
triangle, or in a new triangle. The parameters t e dge and 
t V ect may be used to determine the state of Pi. A normal 

N to the plane containing P 0 Pi and ViV 2 can be found 
15 using the equation: 

n = p 0 p } *v x v 2 

and its maximum component may be found using the 
equation: 

20 Axes = max(n x , n y/ n z ) . 

The plane orthogonal to its maximum component is used 
for the projection of the current triangle vertices and 
tracking points. 

The new tracking position will be a function 
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of the newly found parameters t ve ct/ t edge and the current 
state of the tracking point. For example, the following 
equations can be solved for t vec t and t e d ge : 

[(Pi-Po) " (V 2 -Vi)] [ t vect ]= Vi - P 0 

Referring to FIGS. 5A and 5B as shown at 70 and 72, 
respectively, the value of the parameters t ve ct and t ed ge 
will determine if Pi is inside that same triangle as P 0 , 
10 lies beyond a specific edge or vertex of the current 
triangle, or if the remaining edges must be checked. 
The sector pair in which the new point Pi falls is 
defined in the regions: 

(t V ect^ 0; tedge > 1/ 0 < t e d ge <1) - 

15 The distance along the tracking line is determined from 
the parameter t vect , which is similarly bounded: 

(tvect < 0; tvect > 1/ 0< t V ect ^1) • 

By examining the various combinations of t vect and t e dge/ 
it can be determined whether the projected point falls 

20 inside or outside the current triangle 52. The plane 
containing the current triangle 52 is subdivided into 
slices 66 according to the value of t e dge/ and in stripes 
67 according to the value of t vec t/ as shown in FIGS. 5A 
and 5B, respectively. It should be appreciated that, in 

25 this example, both t vec t and t e dge are between zero and 
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one. The methodology advances to diamond 125. 

In diamond 125, the methodology determines if 
the state flag is set to INSIDE . If the state flag is 
set to INSIDE, the methodology advances to circle B and 

5 continues. If the state flag is not set to INSIDE, the 
methodology advances to diamond 130. In diamond 130, 
the methodology determines if the state flag is set to 
EDGE. If the state flag is set to EDGE, the methodology 
advances to circle C and continues. If the state flag 

10 is not set to EDGE, the methodology advances to block 
135. 

In block 135, the methodology concludes the 
state flag is set to VERTEX. The methodology advances to 
circle D in FIG. 3D and continues. 

15 The methodology returns in circle E and 

advances to block 145. In block 145, the methodology 
advances to circle F shown in FIG. 3E and continues. 

Referring to circle B shown in FIG. 3B, the 
methodology continues by examining the different 

20 combinations of t vect and t ec ige to locate Pi. The 
methodology advances to diamond 205 and determines if a 
condition is met indicating that Pi is inside the 
current triangle 52. An example of a condition is if 
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tvect ^ 1 and 0 < tedge £l. If the condition is met, the 
methodology advances to block 210. 



the new tracking point Pi is inside the current triangle 
5 52 . An example of a tracking point contained within the 
current triangle 52 is illustrated in FIG. 9A at 79. 
Advantageously, the new tracking position is immediately 
found by substituting either parameter in the set of 
equations : 

10 P V ect = Po + t V ect * (Pi" Po ) and 



previous iteration is set equal to the initial point Po, 
for use in finding the next new tracking' point 64. The 

15 methodology advances to block 215. 

In block 215, the methodology sets the state 
flag to INSIDE. The methodology advances to circle E in 
FIG.3A and continues. 

Returning to diamond 205, if the condition is 

20 not met, the methodology advances to diamond 220. In 
diamond 220, the methodology determines if a condition 
is met that P x is crossing to a new triangle shown at 68 
over a vertex. For example, if 0 < t vec t < 1, the 
tracking point is exiting the current triangle 52 



In block 210, the methodology concludes that 




* (V 2 - Vi) 



The new tracking point Pi found on the 
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crossing the V1V3 edge, as illustrated in FIGS. 5A and 
5B. If the condition is not met that Pi is crossing to a 
new triangle 68, the methodology returns to circle A in 
FIG. 3A and looks at another edge to find an 

5 intersection. 

Returning to diamond 220, if the condition is 
met that Pi is crossing to new triangle 68, the 
methodology advances to block 225. In block 225, the 
methodology uses a look up table (not shown) containing 

10 various geometrically derived combinations of t vec t and 
tedge to determine the state, and sets the state flag 
equal to the state looked up in the table. The 
methodology advances to block 230. 

In block 230, the methodology sets T A equal to 

15 T new , since there is insufficient information to tell the 
position of the new tracking point 64. The methodology 
advances to Circle A in FIG. 3A and continues. 

Referring to Circle C shown in FIG 3C, the 
methodology advances to diamond 305 and determines a 

20 new tracking point 64 from a previous tracking point on 
an edge 58. Preferably it is determined if the new 
tracking point is crossing over to a new triangle 68 or 
whether it is stuck on an edge 58 of the current 
triangle 52. Referring to FIGS. 6A and 6B, a side view 
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of two facets 62 connected at an edge 58 are 
illustrated at 73 and 74 respectively. Referring to 
FIGS. 7A and 7B shown at 75 and 76, respectively, 
various alternatives as a function of t vect and t edqe are 
5 further illustrated. In diamond 305, the methodology 
determines if a condition is met that the new tracking 
point 64 is moving inside the current triangle 52. An 
example of this condition is if: 



10 If the condition is met, the methodology advances to 
block 310. 



the new tracking point 64 lies inside the current 
triangle 52. The methodology advances to block 315. 
15 In block 315, the methodology sets a state flag to 
INSIDE. The methodology advances to circle E in FIG. 
3A and continues . 



is not met that the new tracking point 64 is moving 
20 inside the current triangle 52, the methodology 
advances to diamond 320 and determines if a condition 
is met that the new tracking point 64 is still on the 
same edge of the current triangle 52. An example of 
this condition is if t vect > 0 and t edLqe < 0; or if t vec t ^ 



t V ect ^ 1 and 0 < t edge < 1. 



In block 310, the methodology concludes that 



Returning to diamond 305, if the condition 
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0 and tedge ^0- If this condition is met, the 
methodology advances to block 325 and concludes that 
the new tracking point 64 is constrained on the current 
edge 58 of the current triangle 52. The methodology 
5 advances to block 330 and sets the state flag to EDGE. 
The methodology advances to circle E in FIG . 3A and 
continues . 

Returning to diamond 320, if the condition is 
not met that the new tracking point 64 is still on the 

10 same edge of the current triangle 52, the methodology 
advances to diamond 335. In diamond 335, the 

methodology determines whether a condition is met 
indicating the new tracking point 64 is crossing over 
to a new triangle 68. An example of this condition is 

15 if 0 < tvect < 1 and 0 < t ed g e < 1. If the condition is 
not met that the new tracking point 64 is crossing over 
to a new triangle 68, the wrong edge was selected and 
the methodology returns to circle A shown in FIG. 3A 
and continues with another edge. 

20 Returning to diamond 335, if the condition is 

met that the new tracking point 64 is crossing over to 
a new triangle 68 either through one of the vertexes V lf 
V 2 or the edge ViV 2/ and the methodology advances to 
block 340. In block 340, the methodology concludes 
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that the new tracking point 64 is crossing over to a 
new triangle 68. The methodology sets the state flag 
according to the value of t e dge and t vec t- For example, 
the various combinations of conditions for t e dge and t ve ct 
5 can presented in a matrix form and used as a look-up 
table (not shown) to set the state flag. It should be 
appreciated that several iterations may be necessary to 
determine the final position of the new tracking point 
C3 Pi. The methodology returns to circle A in FIG. 3A and 

W* 10 continues in locating the tracking point. 

tf 1 Referring to Circle D shown in FIG. 3D, the 

fn 

t3 . methodology assumes that the state of the current 

s tracking point 54 is a VERTEX. It should be appreciated 

C3 that the new tracking point 64 may be moving across a 

M 15 vertex 60 and could project on any of the new triangles 

C3 68 connect to the given vertex 60. Preferably, the 

mesh is checked for gaps, that is, the set of triangles 
connected to the vertex 60 may not form a closed 
manifold. Further, if the new tracking point 64 
20 projects on more than one new triangle 68, that 
triangle 68 should be determined. Referring to FIGS. 
8A and 8B as shown at 77 and 78 respectively, various 
cases are illustrated for a vertex. The methodology 
advances to diamond 4 05. 
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In diamond 405, the methodology determines if 
a condition is met that the new tracking point 64 is 
moving from the vertex back into the current triangle 
52 connected with the vertex. An example of this 
5 condition is if: 

tvect ^1 artd 0 < tedge < 1- 

If the condition is met, than the new 
tracking point 64 is moving from the vertex into the 
current triangle 52. The methodology advances to block 
10 410. In block 410, the methodology concludes that the 
new tracking point is found. The' methodology advances 
to block 415 and sets a state flag to INSIDE. The 
methodology advances to circle E in FIG. 3A and 
continues . 

15 Returning to diamond 405, if the condition is 

not met, that the tracking point is moving from the 
vertex 60 to inside the current triangle 52, the 
methodology advances to diamond 420. 

In diamond 420, the methodology determines if 

20 a condition is met that the new tracking point 64 is 
moving from the vertex 60 to an edge 58. For example, 
if t V ect ^ 1 and (t edge = 0 or t edge = 1), then the new 
tracking point 64 is moving from the vertex 60 to an 
edge 58. If the condition is met that the new tracking 
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point 64 is moving from the vertex 60 to an edge 58, 
the methodology advances to block 425. In block 425, 
methodology concludes that a new tracking point 64 is 
along an edge 58. The methodology advances to block 
5 430 and sets a state flag equal to EDGE. The 
methodology advances to circle E in FIG. 3A and 
continues . 

Returning to diamond 420, if a condition is 
not met that the new tracking point 64 is moving from 

10 the vertex 60 to an edge 58, the methodology advances 
to diamond 435. In diamond 435, the methodology 
assumes that the new tracking point 64 is crossing over 
to a new triangle 68. The methodology determines if a 
condition is met that the new tracking point 64 is on 

15 an edge 58 of a new triangle 68. For example, if: 

t V ect ^0 and (t ed ge<0 Or t e dge>D; Or 
0<t e dge<l and 0<t e dge < 1/* 

then the new tracking point 64 is moving to an edge of 
a new triangle 68. If a condition is met that the new 
20 tracking point 64 is moving to an edge 58 of a new 
triangle 68, the methodology advances to block 440. 

In block 440, the methodology concludes that 
the new tracking point 64 has crossed over to a new 
triangle 68 and is on an edge 58, but cannot conclude 
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whether this is the final position of the new tracking 
point 64. The methodology advances to block 4 45 and 
sets a state flag to EDGE. The methodology returns to 
circle A in FIG. 3A and continues determining the 
5 position of the tracking point. 

Returning to diamond 4 35, if a condition is 
not met that the new tracking point 64 is moving to a 
new triangle 68 and is on an edge 58, the methodology 
advances to diamond 450. In diamond 450, the 

10 methodology determines if a condition is met that the 
new tracking point 64 has crossed onto a vertex 60 of 
the new triangle 68. For example, if: 

0 < t V ect < 1 and (tedge = 0 Or t edge = 1), 

the new tracking point 64 has moved onto a vertex of a 
15 new triangle 68. If the condition is met that the new 
tracking point 64 has crossed onto a vertex 60 of the 
new triangle 68, the methodology advances to block 455. 

In block 455, the methodology concludes that 
the new tracking point 64 has moved to a vertex 60 of a 
20 new triangle 68, but the methodology cannot assume that 
this is the final position of the new tracking point 
68. The methodology advances to block 4 60 and sets a 
current state flag equal to VERTEX. The methodology 
advances to circle A in FIG. 3A and continues to find 
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the position of the new tracking point 64. 

Returning to diamond 450, if the condition is 
not met that the new tracking point 64 has crossed into 
a new triangle 68 and is on a' vertex 60, the 
5 methodology advances to diamond 4 65. In diamond 4 65, 
the methodology determines if a condition is met 
indicating there is a new edge 58 of the current 
triangle 52 to check for locating the new tracking 
point 64. If the condition is not met indicating there 

10 is a new edge 58 to check, the methodology advances to 
block 470. In block 470, the methodology concludes 
that the new tracking point 64 is on the same vertex 60 
on the current triangle 52. The methodology advances 
to block 475 and sets a state flag equal to a VERTEX. 

15 The methodology advances to circle E in FIG. 3A and 
continues. 

Returning to diamond 4 65, if the condition is 
met that there is a new edge 58 to check, the 
methodology advances to block 480. The methodology 
20 concludes that the new tracking point 64 is stuck on an 
edge 58. The methodology sets the current state flag 
to EDGE. The methodology advances to circle A in FIG. 
3A and continues to determine which edge the tracking 
point is on. 



# • 

31 



It should be appreciated that more than one 
iteration of the methodology may be necessary to 
determine the new tracking point 64. For example, if 
the new tracking point 64 gets close to the current 
5 triangle boundary, a small displacement may cause it to 
cross the edge 58 into a new triangle 68. As 
illustrated in FIGS. 9B and 9C at 80 and 81 
respectively, during a first iteration (FIG. 9B) , the 
tracked point is dropped onto the plane containing the 

10 current facet shown at 82, and the intersection with 
the boundary is found. The state flag is set to EDGE, 
the neighboring triangle becomes the current facet. 
During the second iteration, (FIG. 9C) , the tracked 
point shown at 83 is dropped onto the plane containing 

15 the newly set current triangle, which is inside the 
facet. The state flag is set to INSIDE. 

Similarly, if the displacement is large, 
three iterations are required to find the new tracking 
point, as shown in FIGS. 10A, 10B and 10C at 84, 85 and 

20 86 respectively. It should be appreciated that the 
number of iterations is generally equal to the number 
of crossed triangles. As illustrated in FIGS. 11A, 11B 
and 11C shown at 87, 88, and 89 respectively, the 
tracking point 64 is initially inside the triangle as 
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shown in FIG. 11A. It drops at the edge 58 with the 
neighboring triangle. In the next iteration the 
tracking point 64 moves back to the previous triangle 
as shown in FIG. 11B at 88. The methodology determines 
5 that the tracking point 64 is constrained on a convex 
edge. Once the tracking point 64 is constrained on an 
edge, various scenarios are possible, as shown in FIGS. 
11C, 12A through 12D and 13A through 13D. Referring to 
FIG 11C, the new tracking point 64 drops outside the 

10 current edge and inside the current triangle 52 as 
shown at 89. The methodology determines that the new 
tracking point 64 is inside the current triangle 52. 

As illustrated in FIGS. 12A, 12B, 12C, and 
12D at 90, 91, 92 and 93 respectively, if the 

15 displacement vector does not drop onto either semi- 
plane, the methodology will try to move the tracking 
point from the current edge to a neighboring facet, and 
then back to the original triangle. However, the 
tracking point 64 is constrained on an edge, and moves 

20 along the edge. As shown in FIG. 12D at 93, the 
tracking point 64 keeps sliding along the edge 58 until 
it reaches a vertex 60. 

Once on the vertex 60, the tracking point 64 
remains there as shown in FIG. 13A until the 
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displacement is large enough to move onto a connected 
edge, as shown in FIG. 13B at 95, or a connected 
triangle, as shown in FIG. 13D at 97, or if contact is 
broken, as shown in FIG. 13C at 96. 

5 Referring to circle F shown in FIG. 3E, the 

methodology determines a force feedback of the new 
tracking point 64 . Force feedback refers to penetration 
of the tracking point into the plane representing the 
surface of the model 18. As illustrated in FIG. 14, a 

10 higher level first computer system 38 is utilized to 
check for collisions with the mesh and track a point on 
the mesh once a collision has occurred, as well as 
provide this information to a lower level second 
computer system 40. The second computer system 40 can 

15 operate at a higher refresh rate than the higher level 
first computer system 38, and can be used to determine 
and apply a continuous force feedback through the force 
feedback device 12 to the user 14. It should be 
appreciated that the new tracking point 64 is 

20 constrained to be on the mesh of the model and follows 
the force feedback device 12. It should also be 
appreciated that the tracking point can be lying on 
either a facet 62, an edge 58, or a vertex 60. The 
methodology begins in circle F, and continues to 
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diamond 505. 

In diamond 505, the methodology determines if 
a state flag is set to INSIDE. If the state flag is 
set to INSIDE, the methodology advances to block 510 
5 and calculates a force and applies the force through 
the force feedback device 12. In this example, the 
force is modeled as a uniformly distributed spring and 
damper mesh as shown in FIG. 15 at 98, and determined 
using: F=(K p + sK d ) (P 0 P d * N)N 
10 F= (P 0 P d * N) N 

F=(P 0 P d * N) N 

where K d is a damping coefficient and K p is a stiffness 
coefficient for a spring, P 0 is any point on the mesh 
and P d is the position of the tracking point. The 

15 calculated force is applied using the force feedback 
device 12, and more specifically the end effector 20, 
to replicate the feeling of contact with a rigid object 
18. The methodology advances to circle 570 and ends. 

Returning to diamond 505, if the state flag 

20 is not set to INSIDE, the methodology advances to 
diamond 515. In diamond 515, the methodology 

determines if the state flag is set to EDGE. If the 
state flag is not set to EDGE, the methodology advances 
to block 520. In block 520, the methodology assumes 



35 



that the new tracking point 64 is on a vertex 60, and 
calculates the contact force and applies the calculated 
contact force using the force feedback device 12. In 
this example, the vertex 60 is locally approximated as 
5 a gravitational sphere, and the contact force is 
calculated using: 

F = K(P d _ P 0 ) . 

It should be appreciated that the force feedback de.vice 
12 will apply the calculated contact force until it 

10 receives an update on a new tracking point 64 from the 
higher level first computer system 38. The methodology 
advances to circle 570 and ends. 

Returning to diamond 515, if the state flag 
is set to EDGE, the methodology .advances to diamond 

15 525. In diamond 525, the methodology knows that the new 
tracking point 64 is on an edge 58, but may have moved. 
It should be appreciated that the methodology knows 
that P 0 is a point on the edge, ni and n 2 are normal to 
two planes forming the edge, and £ edge is a unit vector 

20 aligned with the edge. The methodology determines if a 
condition is met indicating the new tracking point 64 
has moved to free space. An example of this condition 
is if P 0 P d * Ni ^ 0 and P 0 P d * N 2 ^ 0. If the condition is 
met that the new tracking point 64 has moved to free 
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space, the methodology advances to block 530. 

In block 530, the methodology concludes that 
the new tracking point 64 has moved to free space, and 
calculates and applies the contact force. In this 

5 example, free space refers to an occurrence of the end 
effector 20 of the force feedback device 12 breaking 
contact with the surface of the model 18. Therefore, 
the applied contact force is zero, F=0. The methodology 
advances to circle 57 and ends. 

10 Returning back to diamond 525, if the 

condition is not met that the new tracking point 64 is 
moving to free space, the methodology advances to block 
535. In block 535, methodology concludes that the new 
tracking point 64 is on an edge 58, but the new 

15 tracking point may be locked onto the edge 58, or 
sliding on one of the two connected facets 62 with the 
edge 58. The methodology finds a vector perpendicular 
to the edge. For example, the vector (V) is determined 
from: 

20 V + P 0 P d - (PoPd * £ edge ) edge 

Where ^ e dge = ni * n 2 is a vector collinear with 
the edge. The remaining vector is projected along two 
vectors coplanar with the two facets and orthogonal to 
the edge. The methodology advances to diamond 540. 
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In diamond 540, the methodology determines if 
the tracking point 64 is on top of the first plane, or 
second plane, or locked on the edge. The methodology 
first determines if a condition is met indicating that 
5 the tracking point 64 is on the first plane. An 
example of such a condition is if: 

[V * (-m) ] * ^ edge ^ 0 and 

[V * (-n 2 ) ] * ^edge * 0. 

10 If the condition is met that the tracking point 64 is 
on the first plane, the methodology advances to block 
545. 

In block 545 the methodology concludes that 
the new tracking point 64 is on plane ni and determines 
15 the contact force and applies the calculated contact 
force. For example, the contact force can be 

calculated using: 

F = K (P 0 P d - ruJNx. 

20 The calculated contact force is applied to the end 
effector 20 of the force feedback interface 12. The 
methodology advances to circle 570 and ends. 

Returning to diamond 540, if the condition is 
not met that the point is on a first plane, the 
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methodology advances to diamond 550. In diamond 550, 
the methodology determines if a condition is met 
indicating that the tracking point 64 is on a second 
plane. An example of this condition is: 

5 [V * (-Ni)] * ^edge< 0 and [V * (-N 2 )] * t edge * 0. 

If the condition is met that the point is on the second 
plane, the methodology advances to block 555. 

In block 555 the methodology concludes that 
the new tracking point 64 is on plane n 2 and determines 
10 the contact force and applies the calculated contact 
force. For example, the contact force can be 

calculated using: 

F=K(P 0 P d - N 2 )N 2 . 
The calculated contact force is applied to the end 
15 effector 20 of the force feedback device 12. The 
methodology advances to circle 570 and ends. 

Returning to diamond 550, if the condition is 
not met that the new tracking point 64 is on the second 
plane, the methodology advances to block 560. In block 
20 560, the methodology concludes that the new tracking 
point 64 is still on an edge. The methodology further 
determines the contact force and applies the calculated 
contact force. For example, the contact force can be 
calculated using: 
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F=K(P 0 P d " N 2 )N 2 . 
The calculated contact force is applied to the end 
effector 20 of the force feedback device. The 
methodology advances to circle 570 and ends. 
5 The present invention has been described in 

an illustrative manner. It is to be understood that 
the terminology, which has been used, is intended to be 
in the nature of words of description rather than of 
limitation. 

10 Many modifications and variations of the 

present invention are possible in light of the above 
teachings. Therefore, within the scope of the appended 
claims, the present invention may be practiced other 
than as specifically described. 
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